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Abstract: We analyze the Two Level Processor Sharing (TLPS) scheduling discipline with the 
hyper-exponential job size distribution and with the Poisson arrival process. TLPS is a convenient 
model to study the benefit of the file size based differentiation in TCP/IP networks. In the case 
of the hyper-exponential job size distribution with two phases, we find a closed form analytic 
expression for the expected sojourn time and an approximation for the optimal value of the 
threshold that minimizes the expected sojourn time. In the case of the hyper-exponential job size 
distribution with more than two phases, we derive a tight upper bound for the expected sojourn 
time conditioned on the job size. We show that when the variance of the job size distribution 
increases, the gain in system performance increases and the sensitivity to the choice of the threshold 
near its optimal value decreases. 
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Le Choix du Seuil Optimal pour La File d'Attente Munie 
d'une Politique a Temps Partage Avec Deux-Niveaux 

Resume : Nous etudions la file d'attente munie d'une politique a Temps Partage avec Deux- 
Niveaux "Two Level Processor Sharing" avec distribution hyper- exponentielle des temps de service 
ct avec lo processus d'arrivoo Poisson. TLPS est un modolo commode pour ordonncr I'acccs aux 
ressources en fonction de la taille dans un reseau TCP /IP. Dans le cas ou la distribution du temps 
de service est une distribution hyper- exponentielle avec deux phases, nous trouvons une expression 
analytique pour le temps de reponse moyen. Aussi nous trouvons une approximation de valeur de 
seuil optimal qui reduit au minimum le temps de reponse moyen. Dans le cas ou la distribution 
du temps de service a plus que deux phases, nous trouvons une borne superieure pour la fonction 
de temps de reponse moyen qui est conditionnee au temps dc service. Nous montrons que quand 
la variance de la distribution des temps de service augmente, le gain dans I'execution du systeme 
est considerable et il n'y a pas de sensibilite au choix du seuil sous optimal. 

Mots-cles : La file d'attente munie d'une politique a Temps Partagees avec Deux-Niveaux, 
reseau TCP/IP, distribution hyper-exponentielle, Laplace transforment. 
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1 Introduction 

It has been known for a long time that a clever scheduling of tasks can significantly improve 
system performance. For instance, Shortest Remaining Processing Time (SRPT) scheduling dis- 
cipline minimizes the expected sojourn time jl5]. However, SRPT requires to keep track of all 
jobs in the system and also requires the knowledge of the remaining processing times. These 
requirements are often not feasible in applications. The examples of such appHcations are file size 
based differentiation in TCP/IP networks [21 [9] and Web server request differentiation |10[ lllj. 

The Two Level Processor Sharing (TLPS) scheduling discipline [12] helps to overcome the 
above mentioned requirements. It uses the differentiation of jobs according to a threshold on the 
attained service and gives priority to the jobs with small sizes. A detail description of the TLPS 
discipline is presented in the ensuing section. Of course, TLPS provides a sub-optimal mechanism 
in comparison with SRPT. Nevertheless, as was shown in [Ij, when the job size distribution has 
a decreasing hazard rate, the performance of TLPS with appropriate choice of threshold is very 
close to optimal. It turns out that the distribution of file sizes in the Internet indeed has a 
decreasing hazard rate and often could be modeled with a heavy-tailed distributions. It is known, 
that the heavy-tailed distribution could be approximated with a hyper-exponential distribution 
with a significant number of phases [3 [8]. Also in [7j, it was shown that the hyper-exponential 
distribution models well the file size distribution in the Internet. Therefore, in the present work 
we analyze the TLPS system with hyper-exponential job size distribution. 

The paper organization and main results are as follows. In Section [2] we provide the model 
formulation, main definitions and equations. In Section [3] we study the TLPS discipHne in the 
case of the hyper-exponential job size distribution with two phases. It is known that the Internet 
connections belong to two distinct classes with very different sizes of transfer. The first class is 
composed of short HTTP connections and P2P signaling connections. The second class corre- 
sponds to downloads (PDF files, MPS files, MPEG files, etc.). This fact provides motivation to 
consider first the hyper-exponential job size distribution with two phases. 

We find an analytical expression for the expected sojourn time in the TLPS system. Then, we 
present the approximation of the optimal threshold which minimizes the expected sojourn time. 
We show that the approximated value of the threshold tends to the optimal threshold when the 
second moment of the job size distribution function goes to infinity. 

We show that the use of the TLPS scheduling discipline can lead to 45% gain in the expected 
sojourn time in comparison with the standard Processor Sharing. We also show that the system 
performance is not too sensitive to the choice of the threshold around its optimal value. 

In Section|4]we analyze the TLPS discipline when the job size distribution is hyper-exponential 
with many phases. We provide an expression of the expected conditional sojourn time as the 
solution of a system of linear equations. Also we apply an iteration method to find the expression 
of the expected conditional sojourn time and using the resulting expression obtain an explicit and 
tight upper bound for the expected sojourn time function. In the experimental results we show 
that the relative error of the latter upper bound with respect to the expected sojourn time function 
is 6-7%. 

We study the properties of the expected sojourn time function when the parameters of the 
job size distribution function are selected in a such a way that with the increasing number of 
phases the variance increases. We show numerically that with the increasing number of phases 
the relative error of the found upper bound decreases. We also show that when the variance of 
the job size distribution increases the gain in system performance increases and the sensitivity of 
the system to the selection of the optimal threshold value decreases. 

We put some technical proofs in the Appendix. 
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2 Model description 

2.1 Main definitions 

We study the Two Level Processor Sharing (TLPS) scheduhng disciphne with the hyper- 
exponential job size distribution. Let us describe the model in detail. 

Jobs arrive to the system according to a Poisson process with rate A. We measure the job size 
in time units. Specifically, as the job size we define the time which would be spent by the server 
to treat the job if there were no other jobs in the system. 

Let be a given threshold. The jobs in the system that attained a service less than are 
assigned to the high priority queue. If in addition there are jobs with attained service greater than 
9, such a job is separated into two parts. The first part of size 9 is assigned to the high priority 
queue and the second part of size x — 9 waits in the lower priority queue. The low priority queue is 
served when the high priority queue is empty. Both queues are served according to the Processor 
Sharing (PS) discipline. 

Let us denote the job size distribution by F{x). By F{x) = 1 — F{x) we denote the comple- 
mentary distribution function. The mean job size is given by to = xdF{x) and the system 
load is p = Ato. We assume that the system is stable (p < 1) and is in steady state. 

It is known that many important probability distributions associated with network traffic are 
heavy-tailed. In particular, the file size distribution in the Internet is heavy-tailed. 

A distribution function has a heavy tail if e^^(l — F{x)) ^ oo as a; ^ oo, Ve > 0. The heavy- 
tailed distributions are not only important and prevalent, but also difficult to analyze. Often it is 
helpful to have the Laplace transform of the job size distribution. However, there is evidently no 
convenient analytic expression for the Laplace transforms of the Pareto and Weibull distributions, 
the most common examples of heavy-tailed distributions. In [H [8] it was shown that it is possible 
to approximate heavy-tailed distributions by hyper-exponential distribution with a significant 
number of phases. 

A hyper-exponential distribution Fn{x) is a convex combination of N exponents, 1 < iV < oo, 
namely, 

N N 

f^iv(x) = l-^p,;e-^*", n^>0,p^>0, i = l,...,N, and = 1. (1) 

i=l i=l 

In particular, we can construct a sequence of hyper-exponential distributions such that it 
converges to a heavy-tailed distribution [5]. For instance, if we select 

7i — 1 

71 > 1; 2 < 72 < 71 - 1; 

where v = ^/J2i=i n'^~^^^ V = ^/^J2i=i n^'^^~^^^ then the first moment of the job size 
distribution is finite, but the second moment is infinite when iV — > oo. Namely, the first and the 
second moments m and d for the hyper-exponential distribution are given by: 

(2) 



poo -"' POO _ \ 

/ xdFix)^J2-^ ^= / ^^dFix) ^2Y,^- 
Jo M« Jo 



Let us denote 

^f = p,e-'^'^ i = l,...,N. (3) 
We note that J2i = ^i^)- The hyper-exponential distribution has a simple Laplace transform: 

N 
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We would like to note that the hyper-exponential distribution has a decreasing hazard rate. 
In [1] it was shown, that when a job size distribution has a decreasing hazard rate, then with 
the selection of the threshold the expected sojourn time of the TLPS system could be reduced in 
comparison to standard PS system. 

Thus, in our work we use hyper-exponential distributions to represent job size distribution 
functions. In particular, the appHcation of the hyper-exponential job size distribution with two 
phases is motivated by the fact that in the Internet connections belong to two distinct classes with 
very different sizes of transfer. The first class is composed of short HTTP connections and P2P 
signaling connections. The second class corresponds to downloads (PDF files, MPS files, MPEG 
files, etc.). So, in the first part of our paper we look at the case of the hyper-exponential job size 
distribution with two phases and in the second part of the paper we study the case of more than 
two phases. 



2.2 The expected sojourn time in TLPS system 

Let us denote by T (x) the expected conditional sojourn time in the TLPS system for a 
'Yi^pg 

job of size x. Of course, T {x) also depends on 9, but for expected conditional sojourn time 
we only emphasize the dependence on the job size. On the other hand, we denote by T{9) the 
overall expected sojourn time in the TLPS system. Here we emphasize the dependence on 9 as 
later we shall optimize the overall expected sojourn time with respect to the threshold value. 

To calculate the expected sojourn time in the TLPS system we need to calculate the time 
spent by a job of size x in the first high priority queue and in the second low priority queue. For 
the jobs with size x < 9 the system will behave as the standard PS system where the service time 
distribution is truncated at 9. Let us denote by 

V. = / ny"-^F{y)dy (4) 



JQ 

the n-th moment of the distribution truncated aX 9. In the following sections we will need 

The utilization factor for the truncated distribution is 

pe = AXi=p-A^^. (6) 

i=i 

Then, the expected conditional response time is given by 

, xe[0,9], 
^TLPS, ,1 1^ pe 

J W-S w{9)+9 + a{x-9) . 

According to [12], here {W{9) + 9)/{l — pg) expresses the time needed to reach the low priority 
queue. This time consists of the time 9/(1 — pg) spent in the high priority queue, where the fiow 
is served up to the threshold 9, plus the time W{9)/{1 — pg) which is spent waiting for the high 
priority queue to empty. Here W{9) = XXg/{2{l — pg)). 

The remaining term a{x — 9) /{I — pg) is the time spent in the low priority queue. To find 
a{x) we can use the interpretation of the lower priority queue as a PS system with batch arrivals 
[4l[T4]. As was shown in [12], a'{x) ~ da/dx is the solution of the following integral equation 

/•oo PX 

a'{x)^Xn a'(y)B{x + y)dy + Xn a' {y)B{x - y)dy + bB{x) + 1. (7) 
Jo Jq 
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Here n = F{9)/{1 — pg) is the average batch size, B{x) ~ F{0 + x)/F{0) is the complementary 
truncated distribution and b = b{0) = 2XF{9){W{0) + 0)/(l — pg) is the average number of jobs 
that arrive to the low priority queue in addition to the tagged job. 

The expected sojourn time in the system is given by the following equations: 

T{9) = j°° "f-'^ (x)iF(x), 

1- P0 i- - Pe 

—BPS f°° f°° 

I {9)= a{x-e)dF{x)= a'{x)F{x + 6)dx. (9) 
Je Jo 
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3 Hyper-exponential job size distribution with two phases 
3.1 Notations 

In the first part of our work we consider the hyper-exponential job size distribution with two 
phases. Namely, according to |[T|) the cumulative distribution function F{x) for = 2 is given by 

F{x) = 1 -pie-^i^ -pae"''""', 

where pi +P2 = 1 and Pi,P2 > 0. 

The mean job size m, the second moment d, the parameters Fg, Xg, Xg and pe are defined as 
in Section O and Section [121 by formulas JH) , © , I© , JS]) with iV = 2. 

We note that the system has four free parameters. In particular, if we fix /ii, e = /i2//ii, rn, 
and p, the other parameters p2, Pi, P2 and A will be functions of the former parameters. 



3.2 Explicit form for the expected sojourn time 

—T LP S 

To find T (a;) we need to solve the integral equation |(7])- To solve ([7]) we use the Laplace 
transform based method described in [6]. 

Theorem 1. The expected sojourn time in the TLPS system with the hyper- exponential job size 
distribution with two phases is given by 

^' I-P 2{1 - p)F{9){p, + p2 - j{0)F{9)) ' ^ ' 

where 6p{e) = 1 - 7(0)(m - xj) = (1 - p)/(l - pe) and 7(0) - A/(l - pg). 
Proof. We can rewrite integral equation ^ in the following way 

a'{x) = 7(6')/ a'{y)F{x + y + 9)dy + j{e) a'{y)F{x-y + d)dy + b{d)B{x) + l, 
Jo Jq 

a'{x) = 7(f) XI ^e^'^'"" / Oi'{y)e-i'^ydy + j{e) a'{y)F{x-y + 0)dy + b{9)B{x) + l. 

We note that in the latter equation a' {y)e~'^^y dy, i — 1,2 are the Laplace transforms of a'{y) 
evaluated at pi,i — 1,2. Denote 

/>oo 

L,= a'{y)e-''^ydy, i = 1,2. 
Jo 

Then, we have 

a'{x) = 7(0) X Y^L,e-^^'' + -f{9) f a'{y)F{x -y + 9)dy + b{9)B{x) + 1. 

Now taking the Laplace transform of the above equation and using the convolution property, we 
get 

=^ L^'is) i 1 - 7(0) y -^1 = i{e) y + ^y ^ + i. 
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Here La'{s) = a'{x)e^^^dx is the Laplace transform of a'{x). Let us note that 

La'ipi) — Li, i = 1, 2. Then, if we substitute into the above equation s = /ii and s ~ /i2, we can 

get Li and L2 as a solution of the linear system 

BPS 

Next we need to calculate T (0). 



rOO nOO 

/ a'{x)F{x + e)dx ^ a'(a;) ^ Fg^e-'^'^dx = ^ Fg*L„ 

•^0 -^0 ^^12 ^=l,2 



r (e*) = \m~x^ + 



Finally, by JS]) we have □ 



3.3 Optimal threshold approximation 

We are interested in the minimization of the expected sojourn time T{9) with respect to 6. Of 
course, one can differentiate the exact analytic expression provided in Theorem[T]and set the result 
of the differentiation to zero. However, this will give a transcendental equation for the optimal 
value of the threshold. 

In order to find an approximate solution of T {&) — dT{9)/d9 = 0, we shall approximate the 

derivative t' {0) by some function T'{9) and obtain a solution to T'{9opt) = 0. 

Since in the Internet connections belong to two distinct classes with very different sizes of 
transfer (see Section I2.ip , then to find the approximation of T (9) we consider a particular case 
when /i2 << ^1. Let us introduce a small parameter e such that 

£ (m/ii - 1) e {mm - 1) 
fi2 = efJ-i, e ^ 0, pi = 1 , P2 = ■ 



We note that when e ^ the second moment of the job size distribution goes to infinity. 
We then verify that 9opt indeed converges to the minimum of T{9) when e ^ 0. 

Lemma 2. The following inequality holds: fj,ip > X. 



Proof. Since pi > and p2 > 0, we have the following inequality m/ii > 1. Then, m > 
Taking into account that Am — p we get j > Consequently, we have that nip > A. □ 



Consennentlv. we have that ui o > \. 
Proposition 3. The derivative ofT{9) can be approximated by the following function: 



where 



Xjmni - 1) ^ A(m/Ji - 1) 

^i(Mi~A)(l-p)' ip,-Xy ■ ^''> 



Namely, 

T'i9)-f'{9)=0{ti2/pi). 
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Proof. Using the analytical expression for both T (9) and T'{9), we get the Taylor series for 
T (6) — T'{9) with respect to e, which shows that indeed 

T'{9)^f'{9)^0{e). 

□ 

Thus we have found an approximation of the derivative of T{9). Now we can find an approxi- 
mation of the optimal threshold by solving the equation T'{9) = 0. 

Theorem 4. Let 9opt denote the optimal value of the threshold. Namely, 9 opt — argmin T(6'). 
The value 9opt given by 



%pt = In 



(Mi - ^) 



Mi-/^2 Vm2(1-p) 

approximates 9 opt so that T {9 opt) — o(/i2//^i)- 
Proof. Solving the equation 

f'{9) = 0, 

we get an analytic expression for the approximation of the optimal threshold: 

1 .jM^-p)\_ 1 ,„nMi-A) 



7opt = r In I e- 1 = In 



^i(l-e) V (^1 - A) / fii-fi2 VM2(l-p), 
Let us show that the above threshold approximation is greater than zero. We have to show 

(mi -A) 
M2(l-p) 



that > 1. Since /xi > /l<2 and fiip > A (see Lemma[2]), we have 



=^ - P) > M2(l - p) 

=^ A < /.tip < ^1 - /i2(l - p) 

=^ (/il - A) > /i2(l - p). 

Expanding t' {9opt) as a power series with respect to e gives: 

T (9 opt) — e^{consto + consti In e + const2 In^ e), 
where consti, i — 1,2 are some constant value|3 with respect to e. Thus, 

T'{9opt) = o(e) = o(/i2/Aii)> 

which completes the proof. □ 

In the next proposition we characterize the limiting behavior of T{9opt) and T{9opt) as e 0. 
In particular, we show that T{9opt) tends to the exact minimum of T{9) when e — > 0. 



Proposition 5. 



where ci is given by 



limT{9opt) = limr(0opt) = ci. 



^The expressions for the constants consti are cumbersome and can be found using Maple command "series" 
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Proof. We find the following limit, when e — > 0: 

A(m/ii - 1) A(m^i - l)e"^i® 

- - p) - A)(l - p)' 

where ci is given by ifTTI) . Since the function Hnie^o is a decreasing function, the optimal 
threshold for it is 9 opt = oo. Thus, 

fYl 

\imT{9opt) = lim limTf^) ci. 

On the other hand, we obtain 

limr(^opt) = ci, 

which proves the proposition. □ 



lim T(e) 
\imT{e) 

£^0 



3.4 Experimental results 

In Figure 1-2 we show the plots for the following parameters: p = 10/11 (default value), m — 20/11, 
= 1, = 1/10, so A = 1/2 and e = fi2/pi = 1/10. Then, pi = 10/11 and p2 = l/H. 

P5 — 

In Figure 1 we plot T{0), T and T{Oopt)- We note, that the expected sojourn time in 

pQ — 

the standard PS system T is equal to T{Q). We observe that T{dopt) corresponds well to the 
optimum even though e = 1/10 is not too small. 

Let us now study the gain that we obtain using TLPS, by setting 9 = 9opt, in comparison with 

the standard PS. To this end, we plot the ratio g{p) — —pg "'^ in Figure 2. The gain in the 

system performance with TLPS in comparison with PS strongly depends on p, the load of the 
system. One can see, that the gain of the TLPS system with respect to the standard PS system 
goes up to 45% when the load of the system increases. 

To study the sensitivity of the TLPS system with respect to 6*, we find the gain of the TLPS 

system with respect to the standard PS system, we plot in Figure 2 gi{p) — —pi and 

92{p) — ^pS ■ Thus, even with the 50% error of the 9opt value, the system performance is 

close to optimal. 

One can see that it is beneficial to use TLPS instead of PS in the case of heavy and moderately 
heavy loads. We also observe that the optimal TLPS system is not too sensitive to the choice of 
the threshold near its optimal value, when the job size distribution is hyper-exponential with two 
phases. Nevertheless, it is better to choose larger rather than smaller values of the threshold. 
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Figure 1: T{0) - solid line, T {6) - dash dot Figure 2: g{p) - solid line, gi{p) - dash Hne, 
line, Tidopt) - dash Hne 52 (p) - dash dot line 



4 Hyper-exponential job size distribution with more than 
two phases 

4.1 Notations 

In the second part of the presented work we analyze the TLPS discipline with the hyper- 
exponential job size distribution with more than two phases. As was shown in [3 [71 [8], the hyper- 
exponential distribution with a significant number of phases models well the file size distribution 
in the Internet. Thus, in this section as the job size distribution we take the hyper-exponential 
function with many phases. Namely, according to ([1]), 

N N 
i=l i=l 

In the following we shall write simply instead of 

The mean job size m, the second moment d, the parameters Fg, X^, Xg and pg are defined as 
in Section O and Section O by formulas , © , © , JS]) for any 1 < < oo. The formulas 

S 

presented in Section [2121 can still be used to calculate b{9)^ B{x)^ W{0)^ 7(^); ^p{^)j ^ i^)^ 

m. 

We shall also need the following operator notations: 



= 7(0)/ l3{y)F{x + y + 6)dy + ^{9) Piy)F{x - y + e)dy, (12) 

^0 ^0 

nOC 

$2(/3(a;)) = / P{y)F{y + e)dy (13) 
Jo 

for any function f3{x). In particular, for some given constant c, we have 

<i>i(c) = cj{9){m~X^)^cq, (14) 
$2(c) = c(m-Xj), (15) 

where 

fa\r ln\ A(to - X^) p- pg 

q = j(e){m - X^) ^ — < 1. (16) 

1 - pg I ~ pg 
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The integral equation ([7]) can now be rewritten in the form 



a'{x)=<i>,{a'{y))+^F{x + e) + l. (17) 

and equation ([9]) for T [0) takes the form 

T'''''{e) - ^2{a'{x)). (18) 

4.2 Linear system based solution 

Similarly to the first part of the proof of Theorem [H we obtain the following proposition. 
Proposition 6. 

TT^BPS , 



i 

nth 



Li — Lj 



where the L* are the solution of the linear system 



Unfortunately, the system (fTOl) does not seem to have a tractable finite form analytic solution. 
Therefore, in the ensuing subsections we proposed an alternative solution based on an operator 
series and construct a tight upper bound. 

4.3 Operator series form for the expected sojourn time 

Since the operator $1 is a contraction OS], we can iterate equation (fTTl starting from some 
initial point a^. The initial point could be simply a constant. As shown in [Sj H] the iterations 
will converge to the unique solution of (fT7|) . Specifically, we make iterations in the following way: 



«;+i(^) = *iK(2:)) + =^F(x + 0) + l, n = 0,l,2,... (20) 



BPS 

At every iteration step we construct the following approximation of T (6) according to (fTSll : 

R pC 

W = *2(aUi(a;)). (21) 

Using (f20|) and (f2T|) . we can construct the operator series expression for the expected sojourn 
time in the TLPS system. 

Theorem 7. The expected sojourn time T{9) in the TLPS system with the hyper-exponential joh 
size distribution is given by 
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Proof. From (l2Ql we have 



and then from (Ell) and II14D it follows, that 



T^/'ie) = (m - X^) (^q"a', + E + ^ (^E + ^))' 

Using the facts (see lfT6|) ): 

1. g < p < 1 =^ g" ^ as n ^ oo, 

1 1 - 



1=0 ^ 



we conclude that 



Finally, using ^ we obtain ([221) • □ 

The resulting formula l(22|) is difficult to analyze and does not have a clear analytic expression. 
Using this result in the next subsection we find an approximation, which is also an upper bound, 
of the expected sojourn time function in a more explicit form. 

4.4 Upper bound for the expected sojourn time 

Let us start with auxihary results. 
Lemma 8. For any function (3{x) > with f3j = I3{x)e~'^^^dx, 

if ^^(/^l/fil > 0, j==l,...,7V it follows, that $2 < (7*2 (/3(a;)) . 

Proof. See Appendix. □ 

Lemma 9. For the TLPS system with the hyper- exponential job size distribution the following 
statement holds: 

$2(*i(a'(x))) <g$2(«'(a;)). (23) 

Proof. We define a'j — J^^a'{x)e^^^^^dx, j — 1, ...N. As was shown in [lA^, a'{x) has the 
following structure: 

a'(a;) =ao + E"'='^"'"''' ao > 0, > 0, 5^ > 0, k=l,...,N. 

k 

Then, we have that a'{x) > and 

djfx'jtJ-j) _ ■sp flfc \ - ak^^J _ \ - akbk ^ „ ^ 

'^b, + ^,, 2^(bk + n,y^^{bk + f^j)^- ' ^" ' 

as ak > 0, bk > 0, k — 1, N. So, then, according to Lemma[8] we have (|23l) . □ 
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Let us state the following Theorem: 

Theorem 10. An upper bound for the expected sojourn time T{6) in the TLPS system with the 
hyper- exponential job size distribution function with many phases is given by T{0): 

_ + W(9)F(e) m~XJ 6(61) v-^ MF^ , , 

T(0) < T 6* = — ^ + ^ + = — > — 2— ^. 24 

\-PB i-p F{e){i-p)^ + H 

Proof. According to the recursion l|20p we have for a'^ {x) we approximate a'{x) with the function 
a'{x), which satisfies the following equation: 

a'{x)^a'{x)^,{l) + ^F{x + 9) + l. 

Then, according to lfT4|) we can find the analytical expression for a'{x): 

a'ix)^qa'{x) + M^Fix + e) + l, 

QPg BPS 

We take T {6) ^ $2 ("'(a;)) as an approximation for T (0) = $2(a'(a;)). Then 



Let us prove, that 



1-g F{e) 1-q F{e)^^JL^ + ^iJ 



or equivalently 



T^^"(^)<T^^"(^), 



rj^BPS^^^ _ ^BPS^^^ ^ $2(«'(S)) - ^2{a'{x)) < 0. 



Let us look at 

$2(a'(a:))-$2(5'(.T)) = 

= $2(<i>i(a'(x))) + $2 [=^Fi^ + 9) + l^- (q-f2ia'ix)) + $2 (^^(^ + 0) + 
= $2($i(a'(a:))) - q<i>2{a\x)) + q ($2(«'(a;)) - *2(3'(a;))) 

$2(a'(x)) - $2(5'(x)) = ^ (a>2($i(a'(a;))) - g$2(a'(x))) . 

And from Lemma[9]and formula ([8]) we conclude that l|24p is true. □ 

In this subsection we found the analytical expression of the upper bound of the expected sojourn 
time in the case when the job size distribution is a hyper-exponential function with many phases. 
In the experimental results of the following subsection we show that the obtained upper bound 
is also a close approximation. The analytic expression of the upper bound which we obtained is 
more clear and easier to analyze then the expression of the expected sojourn time. It could be 
used in the future research on TLPS model. 
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4.5 Experimental results 



We calculate T{9) and T{9) for different numbers of phases N of the job size distribution 
function. We take N — 10, 100, 500, 1000. To calculate T{9) we find the numerical solution of the 
system of linear equations ifT9|) using the Gauss method. Then using the result of Proposition [6] 
we find T{9). For T{9) we use equation (pi)) . 

As was mentioned in Subsection 12. 1^ by using the hyper-exponential distribution with many 
phases, one can approximate a heavy-tailed distribution. In our numerical experiments, we fix p, 
TO, and select pi and fii in a such a way, that by increasing the number of phases we let the second 
moment d (see ^) increase as well. Here we take 



10/11, A = 0.5, p, = - 



- JL 

j2.5 ' jl.2 ' 



Z = 1,...,7V. 



In particular, we have 



i 

y— = m, 



-2.5 ■ 



In Figure[3]one can see the plots of the expected sojourn time and its upper bound as functions 
of 9 when TV varies from 10 up to 1000. In Figure H] we plot the relative error of the upper bound 

when N varies from 10 up to 1000. As one can see, the upper bound l(2i|) is very tight. 

We find the maximum gain of the expected sojourn time of the TLPS system with respect to 

the standard PS system. The gain is given by g{&) 



T^'^-Tie) 

p3 • 



T 

TT^PS 



Here T is an expected sojourn 



time in the standard PS system. Let us notice, that T = T(0). 
The data and results are summarized in Table [TJ 



N 


V 


d 


dopt 


maxe g{9) 


maxe A(0) 


10 


0.95 


7.20 


5 


32.98% 


0.0640 


100 


1.26 


32.28 


12 


45.75% 


0.0807 


500 


1.40 


113.31 


21 


49.26% 


0.0766 


1000 


1.44 


200.04 


26 


50.12% 


0.0743 



Table 1: Increasing the number of phases 



With the increasing number of phases we observe that 

1. the second moment d increases; 

2. the maximum gain maxg 17(0) in expected sojourn time in comparison with PS increases; 

3. the relative error of the upper bound A(0) with the expected sojourn time decreases after 
the number of phases becomes sufficiently large; 

4. the sensitivity of the system performance with respect to the selection of the sub-optimal 
threshold value decreases. 

Thus the TLPS system produces better and more robust performance as the variance of the 
job size distribution increases. 
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Figure 3: The expected sojourn time T{e) and Figure 4^ The relative error 

its upper bound T{9)) for N = 10, 100, 500, M^) = (T(0) - T(0))/T(0) for N = 10, 100, 

1000 500, 1000 



5 Conclusion 

We analyze the TLPS scheduling mechanism with the hyper-exponential job size distribution 
function. 

In Section [3] we analyze the system when the job size distribution function has two phases and 
find the analytical expressions of the expected conditional sojourn time and the expected sojourn 
time of the TLPS system. 

Connections in the Internet belong to two distinct classes: short HTTP and P2P signaling 
connections and long downloads such as: PDF, MPS, and so on. Thus, according to this obser- 
vation, we consider a special selection of the parameters of the job size distribution function with 
two phases and find the approximation of the optimal threshold, when the variance of the job size 
distribution goes to infinity. 

We show, that the approximated value of the threshold tends to the optimal threshold, when 
the second moment of the distribution function goes to infinity. We found that the gain of the 
TLPS system compared to the standard PS system could reach 45% when the load of the system 
increases. Also the system is not too sensitive to the selection of the optimal value of the threshold. 

In Section |4] we have studied the TLPS model when the job size distribution is a hyper- 
exponential function with many phases. We provide an expression of the expected conditional 
sojourn time as a solution of the system of Hnear equations. Also we apply the iteration method 
to find the expression of the expected conditional sojourn time in the form of operator series and 
using the obtained expression we provide an upper bound for the expected sojourn time function. 
With the experimental results we show that the upper bound is very tight and could be used as 
an approximation of the expected sojourn time function. We show numerically, that the relative 
error between the upper bound and expected sojourn time function decreases when the variation 
of the job size distribution function increases. The obtained upper bound could be used to identify 
an approximation of the optimal value of the optimal threshold for TLPS system when the job 
size distribution is heavy-tailed. 

We study the properties of the expected sojourn time function, when the parameters of the 
job size distribution function are selected in such a way, that it approximates a heavy-tailed 
distribution as the number of phases of the job size distribution increases. As the number of 
phases increases the gain of the TLPS system compared with the standard PS system increases 
and the sensitivity of the system with respect to the selection of the optimal threshold decreases. 
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6 Appendix: Proof of Lemma M 

Let us take any function (3{x) > and define Pj = l3{x)e~'^'^dx, j = 1, N. Let us show 
for P{x) > that if 

diPjH) > J ^ ^^^^^^ ^j^gjj follows that $2 ($i(/3(a;))) < (?$2 (Pix)) . 



As 



and 



^0 



oc poo 



l3{y)F(x-y + 9)F{x + 9)dydx^ / P{y)F{xi + e)F{xi + y + e)dxidy 



POO POO 

$2($i(/3(a;))) = lie) / / P{y)F{x + y + e)F{x + e)dydx 
Jo Jo 

+7(6*) / / PivWix -y + e)F{x + e)dydx, 
Jo Jo 



then 



00 />CXD 



$2(*i(/3(a;))) = 27(61) / / P{x)F{x + 9)F{x + y + 0)dydx = 



f 00 pi pJ 

27(0) / P{x)Y^ lol^e-^^-dx = 27(0)^: -^P,- 

Jo Tj ^' ^ 



Also for $2 taking into account that q = 7(^) -jf-^ we obtain 

g$2(/3(x)) = ^{e)Y,^Y.Po P{x)e-^^^dx^j{e)J2^P: 

Mi Jo -Mi 

Thus, a sufficient condition for the inequality $2 ($i(/3(a;))) < g$2 (/3(a^)) to be satisfied is that 
for every pair 

J Pj + ft < —Pj + —P^ ^ -iPjiij - Pifii)ifij - M.) < 0. 

The inequality is indeed satisfied when Pj^j is an increasing function of ^j. We conclude that 
4'2 ($i(/3(x))) < (7$2 {P{x)), which proves Lemma [H 
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